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UPCONVERSIQN WITH IMPROVED DIAGONAL ENHANCEMENT 
Background Of The Invention 

1. Technical Field 

This invention relates to the field of upconverting interlaced video to 
5 progressive (non-interlaced) video. More particularly, this invention relates to the 
field of deinterlacing algorithms. 

2. Description of Related Art 

The basic idea of selecting between two diagonal averages and a vertical 
average has probably been used by many others previously and was explored by 

10 the Sarnoff Research Laboratories (Sarnoff) in a research project funded by 
Thomson (assignee herein) in the early 1990's. 

A simple method of deinterlacing a field of luminance pixels to create lines 
of pixels that are spatially in between the existing lines of the field is to average the 
values of the pixel directly above and below to create each output pixel. This 

15 method produces jagged edges on diagonal details in the field such as on steps 
that are not horizontal or the on edges of the stripes on a flag as it waves in the 
wind and the angles vary. 

A better method for enhanced diagonal detail, chooses between three pixel 
averages: the vertical average previously described and a left and right diagonal 

20 average. The left diagonal average is computed by averaging the value of the 

pixel to the left and above the position being interpolated with the pixel to the right 
and below. Likewise, the right diagonal is the average of the pixel to the right and 
above the position being interpolated with the pixel to the left and below. 

The basic idea of selecting between two diagonal averages and a vertical 

25 average was explored by the Sarnoff Research Laboratories (Sarnoff) in a 

research project funded by Thomson (assignee herein) in the early 1990's. The 
simplest algorithm choosing between the three choices evaluated by Sarnoff was 
denoted in their report as the DIAG1 algorithm. Other algorithms that Sarnoff 
explored and simulated to attempt to solve the noisy decision problem were 

30 denoted DIAG3, DIAG3W, DIAG3WW. DIAG3 uses a more complicated decision 
algorithm than DIAG1 . DIAG3W adds a noise constraint to the DIAG3 algorithm. 

The DIAG1 algorithm for selecting between two diagonal averages and a 
vertical average computes and compares three differences using the same pixel 
values as the averages. For each average, the corresponding difference is 



WO 03/084110 PCT/US03/08353 

2 

computed and the absolute values of those differences are compared to find a 
minimum. The pixel average that corresponds to the minimum difference is 
selected to be the interpolated value. 

The Sarnoff work mentioned is documented in two reports: Spatially- 

5 Adaptive De-lnterlacina Techniques for Digital Feature TV , December 31,1 990 
and Digital Feature TV Project Final Report . March 31 , 1 991 . 

Even with the use of having multiple choices to consider for a spatial 
interpolation estimate, the existing algorithm is unable to enhance picture quality 
for lower angle diagonals. There is a long-felt need for an improved algorithm that 

10 is effective for lower angle diagonals. 

Summary of the Invention 
A more accurate spatial estimate can be obtained by evaluating nearby 
diagonals. Adding a noise constraint to the decision process of selecting between 
two diagonal averages and the vertical average advantageously improves the 

15 picture quality in the areas where diagonal detail exists. A constraint can 
advantageously be imposed that causes the algorithm to prefer the vertical 
average in ambiguous cases. 

This approach is described in a corresponding application filed concurrently 
herewith and denoted as the DIAG1T algorithm. A pair of constraints is 

20 advantageously applied to the DIAG1 average selection algorithm. Firstly, if the 
minimum difference is not unique, the vertical average is selected. Secondly, if the 
selected average does not lie in the range of values between the pixel above and 
the pixel below the position being interpolated, then the vertical average is 
selected. The resulting diagonal adjacent pixels line-up at angles in the displayed 

25 picture that correspond to or depend upon the sample rate. For a 720x480 picture 
with 4x3 aspect ratio, for example, the corrected diagonals correspond to angles 
as shallow as about 41 degrees above horizontal. The DIAG1T algorithm can only 
improve diagonal features in the picture that are steeper than that angle. 
Nevertheless, the DIAG1T provides a significant improvement in picture quality in 

30 a manner that is relatively simple to implement and which can be implemented at a 
comparatively low cost. 

The present application is directed to a method that, although more complex 
than DIAG1T, improves diagonal enhancement at significantly shallower angles 
than DIAG1T. The second left and second right diagonal averages are also 
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included as choices in a multiple selection process, resulting in this case in a five- 
way selection process denoted as the DIAG5T algorithm. The second left diagonal 
average can be the average between the value of the pixel two pixels to the left 
and above the position being interpolated and the pixel two pixels to the right and 
below the pixel position being interpolated. The second right diagonal can be the 
average of the pixel two pixels to the right and above the pixel position being 
interpolated and the pixel two pixels to the left and below the pixel position being 
interpolated. 

The DIAG5T algorithm chooses between these five choices as follows. 
Firstly, the algorithm chooses between the first left diagonal and the second left 
diagonal by comparing the associated differences. The diagonal with the minimum 
difference is preferably selected with the first diagonal being preferred if the 
differences are equal. Secondly, and similarly to the first step, the algorithm 
chooses between the first right diagonal and the second right diagonal in a similar 
fashion. Thirdly, the algorithm's selection for the interpolated value is chosen from 
the three choices of the selected left diagonal, the vertical average and the 
selected right diagonal, using the same logic as the DIAG1T algorithm, with the 
selected diagonal averages and differences replacing the diagonal averages and 
differences referenced in DIAG1T. 

In a 720x480 picture with 4x3 aspect ratio, for example, the corrected 
diagonals correspond to angles of about 24 degrees above horizontal which 
improves upon the range of angles that the DIAG1T can affect. Diagonal details in 
the picture with angles greater than this angle (24 degrees) can be advantageously 
improved with the DIAG5T algorithm. 

Brief Description of the Drawings 

Figure 1 is a block diagram of the DIAG1T diagonal enhancement 
upconversion system. 

Figure 2 is a diagram useful for explaining the spatial orientation of original 
and interpolated pixels. 

Figure 3 is a block diagram illustrating the details of the Averaging and 
Difference (AVG-DIF) blocks in Figure 1. 

Figure 4 is a block diagram illustrating the signal flow in the DIAG1T circuit 
shown in Figure 1. 

Figure 5 is a block diagram of the DIAG1 decision logic shown in Figure 4. 
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Figure 6 is a block diagram illustrating the DIAG1T constraint logic in Figure 

4. 

Figure 7 is a block diagram of the first part of the DIAG5T diagonal 
enhancement upconversion system in accordance with the present invention. 

Figure 8 is a block diagram of the second part of the DIAG5T vertical 
enhancement upconversion system in accordance with the present invention. 
Detailed Description of the Preferred Embodiments 

The DIAG5T deinterlacing algorithm can be used as a spatial only (intra- 
field) algorithm or as a spatial estimate in a motion adaptive deinterlacing 
algorithm. The DIAG5T incorporates certain elements of the DIAG1 and the 
DIAG1T algorithms, and accordingly, these will be explained first. 

Let the luminance pixel values on two consecutive lines of input video be 
labeled Xij and the interpolated progressive output line pixels be labeled Yij as 
follows, and as shown in Figure 2: 

Input line 1: X11 X12 X13 X14 X15 

Output line: Y11 Y12 Y13 Y14 Y15 

Input line 2: X21 X22 X23 X24 X25 
A simple line average spatial estimate would be: 

Y1j = (X1j + X2j)/2. 

The description of the DIAG1T algorithm given below will focus on 
computing the spatial estimate for the output position Y13. For other output pixels, 
the pixel indices in the description would be adjusted accordingly. An 
implementation of the algorithm can choose to modify the processing described 
herein at the beginnings and ends of lines when required input pixels are not 
available. 

For Y13, the DIAG1T algorithm computes 3 pixel averages and 3 pixel 
differences as follows, and as shown in Figure 1 : 

y1L = (X12 + X24)/2; d1L = abs(X1 2 - X24); 

y1 V = (X13 + X23)/2; d1V = abs(X13 - X23); 

y1 R = (X14 + X22)/2; d1 R = abs(X14 - X22); 
These averages and differences correspond to a left diagonal, a vertical and a 
right diagonal estimate. An exemplary block diagram of a circuit 10 for providing 
all these averages and differences is shown in Figure 1 including a plurality of 
delay circuits 12, 14, 16, 18, and 20 in the form of flip flops and other suitable 
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devices. For example, delay circuit 16 can be a line delay. The circuit further 
includes minimum circuit 22, maximum circuit 24, as well as AVG-DIFF blocks 26, 
28 and 30. The details of an exemplary AVG-DIF block such as the AVG-DIF block 
26 in Figure 1 is shown in Figure 3. AVG-DIF block 26 preferably includes in an 
averaging portion of the device or block, a summer 34 for adding pixel values and 
a divide-by-two circuit 38. In a difference portion, block 26 further includes a 
subtractor 26 and an absolute value function 39. 

The basic DIAG1 algorithm chooses the estimate that corresponds to the 
minimum difference as follows, and as shown in Figure 5: 

Y = y1V; d = d1V; 

if(d1L<d) {y = y1L;d = d1L;} 

if(d1Ft<d) y = y1R; 

Y13 = y; 

More specifically, the basic DIAG1 decision logic 42 can be represented 
using comparators 52 and 58 and multiplexers 54, 56 and 59 coupled as shown in 
Figure 5 to provide the functionality of the DIAG1 algorithm described above, 
although the present invention is not limited thereto. Note that the DIAG1 
algorithm or DIAG1 decision logic 42 forms a part of the overall DIAG1T decision 
logic 32 shown in Figures 1 and 4. 

The noise constraint or the DIAG1T constraint logic 44 shown in Figures 4 and 6 
that is used to clean up decision noise in DIAG1 , and in so doing distinguish 
DIAG1T over DIAG1 , further insists that a value for the given output pixel (Y13) fall 
within a range of values of a top pixel and a bottom pixel defining the vertical 
average for the given output pixel. In terms of equations, this means that either: 

X13<Y13<X23 or X13>Y13>X23 
If this constraint is not satisfied, then output Y13 = y1 V. 

An additional constraint distinguishing DIAG1T is that the left diagonal difference 
either equals or substantially equals the right diagonal difference. In other words, 
the left diagonal difference and the right diagonal difference need to be unique. In 
terms of equations: 

if d1 L = d1 R , then output Y1 3 = y1 V. 
These further constraints are illustrated in Figures 4 and 6. In particular, the 
DIAG1T constraint logic 44 shown in Figure 6 can be embodied by comparators 
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60, 62, and 64, OR gate 66 and multiplexer 68 arranged and coupled as shown to 
provide the functions described above. 

The DIAG5T algorithm uses much of the circuits and methods of the 
DIAG1T algorithm. It is assumed that the video signal is in component form and 
that only the luminance component is processed with the DIAG5T algorithm. A 
simple line average is satisfactory for deinterlacing the two lower resolution 
chrominance components. 

For Y13, the DIAG5T algorithm computes 5 pixel averages and 5 pixel 
differences as follows, and as shown in Figure 7 (part 1 of DIAG5T): 
y1 L2 = (X1 1 + X25)/2; d1 L2 = abs(X1 1 - X25); 
y1 L1 = (X1 2 + X24)/2; d1 L1 = abs(X1 2 - X24); 
y1 V = (X13 + X23)/2; d1V = abs(X13 - X23); 
y1R1 = (X14 + X22)/2; d1R1 = abs(X14 - X22); 
y1R2 = (X15 + X21)/2; d1R2 = abs(X15 - X21); 
These averages and differences correspond to a second and first left diagonal, a 
vertical and a first and second right diagonal estimate. An exemplary block 
diagram of a circuit 70 for providing all these averages and differences is shown in 
Figure 7 including a plurality of delay circuits 71 , 72, 73, 74, 75, 76, 77, 78, and 79 
in the form of flip flops and other suitable devices. For example, delay circuit 75 
can be a line delay. The circuit further includes minimum circuit 86, maximum 
circuit 88, as well as AVG-DIFF blocks 80, 81 , 82, 83 and 84. The details of an 
exemplary AVG-DIF block used in circuit 70 would be similar to the AVG-DIF block 
26 shown in Figures 1 and 3. 

First, the DIAG5T algorithm selects one of the left diagonals and one of the 
right diagonals as follows, and as shown in Figure 8. 
The left diagonal selection is: 

if(d1 L2 < d1 L) {y1 L = y1 L2; d1L = d1 L2;} 
else y1L = y1L1; d1L = d1L1 
The right diagonal selection is: 

if(d1 R2 < d1 R) {y1 R = y1 R2; d1 R = d1 R2;} 
else y1R =y1R1; d1R = d1 R1 
In particular, the DIAG5T diagonal selection logic 90 shown in Figure 8 can be 
embodied by comparators 94 and 97, multiplexers 93, 95, 96 and 98 feeding their 
respective outputs to the DIAG1T decision logic 32 as shown in Figure 4, and 
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further arranged and coupled as shown to provide the functions described above. 
Note that circuit 91 comprises comparator 94 and multiplexers 93 and 95 for 
processing the left and second left diagonal averages and differences and circuit 
92 comprises comparator 97 and multiplexers 96 and 98 for processing the right 
and second right diagonal averages and differences. 

The DIAG5T algorithm then uses the resulting 3 averages and differences (y1 L, 
y1V, y1R, d1L, d1V, d1R), using the same process as the DIAG1T algorithm, first 
selecting an average as follows: 

Y = y1V; d = d1V; 

if(d1L<d){y = y1L; d=d1L;} 

if(dlR<d) y = y!R; 

Y13 = y; Then checking the following constraints, as in the DIAG1T 
algorithm, DIAG5T insists that either: 

X13<Y13<X23 or X13>Y13>X23 
If this constraint is not satisfied, then output Y13 is set to y1 V. An additional 
constraint enforced is that: 

if d1L and d1R are equal, then output Y1 3 is set to y1V. 

Figure 8 illustrates the second part of the DIAG5T algorithm, receiving 
inputs from part 1 in Figure 7. A logic block for processing the two left diagonals 
generates y1L and d1L from y1L1, y1 L2, d1L1 andd1L2. A logic block for 
processing the two right diagonals generates y1 R and d1 R from y1 R1 , y1 R2, d1 R1 
and d1R2. The output of these logic blocks and the V M!N , y1 V, d1 V and V MA x 
outputs of Figure 7 are inputs to decision logic corresponding to the DIAG1T 
algorithm to generate the interpolated output pixel y. The DIAG5T algorithm 
includes a selection step that constrains the result (y) to the vertical average if the 
differences among the averages are ambiguous. Note that in the DIAG5T 
algorithm, the two left diagonal averages can be equal or "ambiguous" (y1L1 = 
y1 L2) and the two right diagonal averages can be equal or "ambiguous" (y1 R1 = 
y1 R2), yet it is the final DIAG1T constraint of the DIAG5T algorithm that constrains 
the interpolated value to the vertical average if the selected left diagonal and the 
selected right diagonal are ambiguous or equal or not unique (y1 L = y1 R). Thus, 
as shown above, among the original 5 averages, the minimum may not necessarily 
be unique. Thomson's Princeton Engine real time digital video simulator was 
programmed to demonstrate the DIAG5T algorithm. In demos with frozen or 
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moving video, areas with diagonal detail are visibly improved. One such scene 
observed had an American flag waving in the wind. The stripes on the flag change 
from horizontal to various angles of diagonal as the flag moved in the wind. The 
improvement of jagged edges on some of the diagonal angles was significant. The 
DIAG5T algorithm is able to improve the edge between stripes of the flag at 
significantly shallower angles to horizontal than, for example, the DIAG1T 
algorithm. The improvement of DIAG5T over DIAG1T is approximately 50% 
greater than the improvement of DIAG1T over a simple vertical average. 

When used as the spatial estimate of a motion adaptive algorithm, the 
DIAG5T algorithm substantially improves moving areas of the picture. Stationary 
regions of the picture already have superior detail from adjacent fields of the video. 
Moreover, in a 720x480 picture with 4x3 aspect ratio, The DIAG5T algorithm 
provides enhancement for diagonals corresponding to angles as shallow as about 
24 degrees above horizontal and steeper. 

In light of the foregoing description of the invention, it should be recognized 
that the present invention can be realized in hardware, software, or a combination 
of hardware and software. A method of interpolating a given output pixel value 
when upconverting interlaced video to progressive video according to the present 
invention can be realized in a centralized fashion in one processing system, or in a 
distributed fashion where different elements are spread across several 
interconnected systems. Any kind of computer system, or other apparatus adapted 
for carrying out the methods described herein, is suited. A typical combination of 
hardware and software could be a general purpose computer processor or digital 
signal processor with a computer program that, when being loaded and executed, 
controls the computer system such that it carries out the methods described 
herein. 

The present invention can also be embedded in a computer program 
product, which comprises all the features enabling the implementation of the 
methods described herein, and which, when loaded in a computer system, is able 
to carry out these methods. Computer program or application in the present 
context means any expression, in any language, code or notation, of a set of 
instructions intended to cause a system having an information processing 
capability to perform a particular function either directly or after either or both of the 
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following a) conversion to another language, code or notation; b) reproduction in a 
different material form. 

Additionally, the description above is intended by way of example only and 
is not intended to limit the present invention in any way, except as set forth in the 
following claims. 
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CLAIMS: 

1 1 . A method for upconverting interlaced video to progressive video with an 

2 improved diagonal enhancement, comprising the steps of: 

3 determining (using 70), from different pixels near a given output pixel, a 

4 plurality of averages and differences, including: a vertical average (y1 V), a first left 

5 diagonal average (y1 L1 ), a second left diagonal average (y1 L2), a first right 

6 diagonal average (y1 R1), a second right diagonal average (y1 R2), a vertical 

7 difference (d1 V), a first left diagonal difference (d1 L1), a second left diagonal 

8 difference (d1 L2), a first right diagonal difference (dl R1 ), and a second right 

9 diagonal difference (dl R2); 

10 selecting (using 90) among the averages (y1 V, y1L1, y1L2, y1Rl, y1R2) 

11 based on an absolute value of a minimal difference among the differences (d1 V, 

12 d1L1, dlL2, dtR1, dlR2); and, 

13 constraining (using 44) the selecting step to the vertical average (y1 V) if the 

14 differences among the averages are ambiguous. 

1 2. The method of claim 1 , wherein the step of selecting among the 

2 averages comprises the steps of selecting between the first left diagonal average 

3 and the second left diagonal average (using 91) to provide a selected left diagonal 

4 average (y1 L) and selecting between the first right diagonal average and the 

5 second right diagonal average (using 92) to provide a selected right diagonal 

6 average (y1 R) based on the minimal difference among the differences. 

1 3. The method of claim 2, wherein the step of selecting further comprises 

2 the step of selecting (using 32) among the selected left diagonal average (y1 L), the 

3 selected right diagonal average (y1 R) and the vertical average (y1 V), based on the 

4 minimal difference among the respective differences. 

1 4. The method of claim 2, wherein the step of selecting further comprises 

2 the steps of selecting the first left diagonal average when the first left diagonal 

3 average and the second left diagonal average are equal and selecting the first right 

4 diagonal average when the first right diagonal average and the second right 

5 diagonal average are equal. 
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1 5. The method of claim 1 , wherein the vertical average is obtained by 

2 adding a luminance component value of a vertically adjacent pixel above the given 

3 output pixel with a luminance component value of a vertically adjacent pixel below 

4 the given output pixel to form a sum which is divided by two. 

1 6. The method of claim 1 , wherein the left diagonal average is obtained by 

2 adding a luminance component value of a diagonally adjacent pixel above and to 

3 the left of the given output pixel with a luminance component value of a diagonally 

4 adjacent pixel below and to the right of the given output pixel to form a sum which 

5 is divided by two and wherein the right diagonal average is obtained by adding a 

6 luminance component value of a diagonally adjacent pixel above and to the right of 

7 the given output pixel with a luminance component value of a diagonally adjacent 

8 pixel below and to the left of the given output pixel to form a sum which is divided 

9 by two. 

1 7. The method of claim 1 , wherein the second left diagonal average is 

2 obtained by averaging the value of the pixel two pixels to the left and above the 

3 given output pixel with the value of the pixel two pixels to the right and below the 

4 given output pixel. 

1 8. The method of claim 1, wherein the second right diagonal average is 

2 obtained by averaging the value of the pixel two pixels to the right and above the 

3 given output pixel with the value of the pixel two pixels to the left and below the 

4 given output pixel. 

1 9. The method of claim 1, wherein the step of constraining comprises 

2 constraining the selection step to the vertical average if a value for the given output 

3 pixel fails to fail within a range of values defined by an adjacent pixel above the 

4 given output pixel and an adjacent pixel below the given output pixel. 

1 10. The method of claim 2, wherein the step of constraining comprises 

2 constraining the selection step to the vertical average if a corresponding difference 

3 for the selected left diagonal average substantially equals a corresponding 

4 difference for the selected right diagonal average. 
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1 11. The method of claim 1 , wherein: 

2 the vertical average is based on pixels vertically adjacent to the given output 

3 pixel; 

4 the first left diagonal average is based on upper left and lower right 

5 diagonally adjacent pixels; 

6 the first right diagonal average is based on upper right and lower left 

7 diagonally adjacent pixels; 

8 the second left diagonal average is based on two pixels to the left and 

9 above the given output pixel and two pixels to the right and below the given output 

10 pixel; and, 

1 1 the second right diagonal average is based on two pixels to the right and 

12 above the given output pixel and two pixels to the left and below the given output 

13 pixel. 

1 12. The method of claim 1 1 , wherein the step of selecting comprises the 

2 steps of: 

3 selecting (using 91 ) between the first left diagonal average and the second 

4 left diagonal average to provide a selected left diagonal average (y1 L); and, 

5 selecting (using 92) between the first right diagonal average and the second 

6 right diagonal average to provide a[ selected right diagonal average (y1 R) based on 

7 the minimal difference. 

1 13. The method of claim 12, wherein the step of selecting further comprises 

2 the step of selecting (using 32) among the selected left diagonal average (y1 LR), 

3 the selected right diagonal average (y1 R), and the vertical average (y1 V) based on 

4 the minimal difference among the respective differences. 

1 14. The method of claim 12, wherein the step of selecting further comprises 

2 the steps of: 

3 selecting the left diagonal average when the left diagonal average and the 

4 second left diagonal average are equal; and, 

5 selecting the right diagonal average when the right diagonal average and 

6 the second right diagonal average are equal. 
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1 1 5. A deinterlacing circuit for upconverting interlaced video to progressive 

2 video, comprising: 

3 means (70) for determining, from different pixels near a given output pixel, a 

4 plurality of averages and differences, including: a vertical average (y1 V), a first left 

5 diagonal average diagonal average (y1 L2), a first right diagonal average (y1 R1 ), a 

6 second right diagonal average (y1 R2), a vertical difference (d1 V), a first left 

7 diagonal difference (d1L1), a second left diagonal difference (d1L2), a first right 

8 diagonal difference (d1R1), and a second right diagonal difference (d1R2); 

9 means (90) for selecting among the averages (y1 V, y1 L1 , y1 L2, y1 R1 , 

10 y1 R2) based on an absolute value of a minimal difference among the differences 

11 (d1V, d1L1, d1L2, d1R1, d1R2); and, 

12 means (44) for constraining the selecting step to the vertical average (y1 V) 

13 if the differences among the averages are ambiguous. 

1 16. The deinterlacing circuit of claim 15, wherein the minimal difference is 

2 ambiguous when: 

3 a value for the given output pixel fails to be within a range of values defined 

4 by an adjacent pixel above the given output pixel and an adjacent pixel below the 

5 given output pixel; or, 

6 the minimal difference among the respective differences fails to be unique. 

1 17. The deinterlacing circuit of claim 15, wherein: 

2 the vertical average is determined from pixels vertically adjacent to the 

3 given output pixel; 

4 the first left diagonal average is determined from upper left and lower right 



5 diagonally adjacent pixels; 

6 the first right diagonal average is determined from upper right and lower left 

7 diagonally adjacent pixels; 

8 the second left diagonal average is determined from two pixels to the left 

9 and above the given output pixel and two pixels to the right and below the given 
10 output pixel; and, 
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1 1 the second right diagonal average is determined from two pixels to the right 

12 and above the given output pixel and two pixels to the left and below the given 

13 output pixel. 

1 18. The deinterlacing circuit of claim 15, wherein the selecting means (90) 

2 comprises: 

3 left diagonal selecting means (91) for selecting between the first left 

4 diagonal average and the second left diagonal average to provide a selected left 

5 diagonal average (y1 L); and, 

6 right diagonal selecting means (92) for selecting between the first right 

7 diagonal average and the second right diagonal average to provide a selected right 

8 diagonal average (y1 R) based on the minimal difference. 

1 19. The deinterlacing circuit of claim 18, wherein the selecting means (90) 

2 comprises output selecting means (32) for selecting among the selected left 

3 diagonal average (y1 L), the selected right diagonal average (y1 R), and the vertical 

4 average (y1 V) based on the minimal difference among the respective differences. 

1 20. The deinterlacing circuit of claim 18, wherein: 

2 the left diagonal selecting means (91) selects the first left diagonal average 

3 when the left diagonal average and the second left diagonal average are equal; 

4 and, 

5 the right diagonal selecting means (92) selects the first right diagonal 

6 average when the right diagonal average and the second right diagonal average 

7 are equal. 
1 

1 
1 
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